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Abstract. We propose a general quantitative scheme in which systems are given the 
freedom to sacrifice energy equi-partitioning on the relevant time-scales of observa- 
tion, and have phase transitions by separating autonomously into ergodic sub-systems 
(clusters) with different characteristic time-scales and temperatures. The details of the 
break-up follow uniquely from the requirement of zero entropy for the slower cluster. 
Complex systems, such as the Sherrington-Kirkpatrick model, are found to minimise 
their free energy by spontaneously decomposing into a hierarchy of ergodically equi- 
librating degrees of freedom at different (effective) temperatures. This leads exactly 
and uniquely to Parisi's replica symmetry breaking scheme. Our approach, which is 
somewhat akin to an earlier one by Sompolinsky, gives new insight into the physical 
interpretation of the Parisi scheme and its relations with other approaches, numerical 
experiments, and short range models. Furthermore, our approach shows that the Parisi 
scheme can be derived quantitatively and uniquely from plausible physical principles. 



I INTRODUCTION 

The so-called Parisi scheme [1] for replica symmetry breaking (RSB) has been 
one of the most succesful tools in the description of (the statics of) disordered sys- 
tems in the non-ergodic or glassy phase. Originally proposed as the solution for 
the Sherrington-Kirkpatrick (SK)-model [2] for mean field spin glasses, it has been 
succesfuUy applied to a wide range of disordered systems. The physical interpre- 
tation of the Parisi scheme has been a subject of many discussions, and has led to 
the introduction of concepts such as disparate time-scales [3], effective temperatures 
[4], low entropy production [5] and non-equilibrium thermodynamics [6]. 

In this paper, we will show how a general scheme in which systems are given the 
freedom to sacrifice energy equi-partitioning by separating autonomously into sub- 
systems with different characteristic time-scales and temperatures, not only yields 
the Parisi scheme, but also introduces all the above-mentioned concepts in a very 
natural way. Our assumptions are simple, and all the quantities that appear in the 
theory, have a clear physical meaning. In section II we briefly discuss systems with 
disparate time-scales, and in section III we apply this to the benchmark problem 



of mean field disordered systems, viz. the SK- model [2] . In section IV we present 
numerical evidence for the existence of multiple disparate time-scales. Finally, in 

the discussion V wc summarize the simple physical picture that naturally emerges 
from our scheme, and discuss the points that still need further investigation. 



II SYSTEMS WITH DISPARATE TIME SCALES 

In this section we briefiy describe how the formalism, as developed and applied 

for Ising spin systems with slowly evolving bonds [7], can be generalised to arbi- 
trary stochastic systems with two or more disparate time-scales. In the case of 
systems with two infinitely disparate time-scales, the faster variables Xf equilibrate 
before the slower ones Xg can effectively change. Therefore, the Xg evolve to an a 
Boltzmann-type equilibrium distribution with an effective energy which is the free 
energy of the xj given the Xs, at an effective inverse temperature (3s, while the Xf 
evolve to the normal Boltzmann equilibrium distribution with /3f — /3: 

Z = Tr,^ {Zf{xs)f , 

Zf{xs) = Trg^ e^p{-f3n{x)) . ^ ' 

One thus obtains a theory with a non-negative replica dimension m = Ps/ p. This 
procedure can be generalised to a system with L + 1 different levels of stochastic 

variables, time-scales and temperatures {{xe, Te, Pe) : £ e {0,1/} }• Assuming that 
each level is adiabatically slower than the next level (t^/t^_i = 0), we obtain the 
following recursion relations 

Z, ^ T,,, {Z,^,r^^ {i<L), 

Zl = Trg^ exp{-PLn{{x})) , ^ ' 

where rhe = (3l — P, and the total free energy of the system, defined on 

the longest time-scale, is given by 

^=-llog(Zo). (3) 



III THE SK-MODEL 

We will now apply this scheme to the SK- model [2], for which the Parisi scheme 
was originally developed. Therefore, we briefiy recall the definitions: 

TV 

^(^) = - I] Jij'^i'^j > (4) 

i<j 

with Gaussian couplings Jij, P{Jij) = N{JojN, J/\/N), and Ising spins aj. 



We assume that there are L + 1 levels of spins with corresponding disparate 
time-scales and temperatures {{a£ — {aj e le}, |/^| = ee,Ti,Ti),i — 0, ..,L} in the 
system, where r^/r^_i = 0, such that larger i correspond to faster spins. Although 
we expect the selection of time-scales for the spins to depend on the specific real- 
isation of the couplings, at present we will make the simplest approximation: the 
system can only choose the relative sizes of the levels. A more detailed study 
of the (annealed) selection of levels will be presented elsewere. To deal with the 
quenched disorder average over the we use the replica trick 



lim:r-5-log2^ ■ 



(5) 



Together with the recursion relations (2) this leads to a nested set of n ni^i nie 
replicas, in which spins at level £ carry a set of replica indices {a}^ = {oq, .., a^}. The 
index oq = 1, ... n comes from the disorder average, whereas — 1, .., = 
The asymptotic free energy per spin is then given by 



/ = lim 



-1 



onPo 



}Ci = Tr exp 
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(6) 



(7) 



e=ojeie 



With the definitions m£ = ^/ = f^t-i/P we have Pqu — Pn, and the connec- 

tion with the original Parisi scheme becomes clear. Note that < < 1, as slower 
clusters cannot have a lower temperature than faster ones, because otherwise the 
latter would act as a heat bath. We now assume full ergodicity at each level in the 
hierarchy of time-scales: 



(8) 



r=0 



(i.e. £ is the slowest level at which {a}L and {b}L differ), to obtain 



"^^+1 / 2 2\ r 1 



j^eej Dz,\og{Ul) , 



(9) 



where 



2 cosh{J (3mi+i Es=o Zs^/qP^q^) , 



fe]^ = E^H-l (?r+l - Qr) , 



r = i + l 



(10) 

(11) 



The physical meaning of the qe is given by 

?^=liniE (••(((•• {<^j)l •• )m)I)i-i..)o, (12) 

J 

where {■)r denotes the average over the level r process, and denotes the disorder 
average. The minimum of the free energy with respect to the ei (with J2i=o = 1, 
for n, rhi positive integers), is at {e^ = 1, — \/£ < L}, and we exactly recover 
the L-th order Parisi solution. Furthermore, the extremization with respect to the 
nil is now recognized to express the fact that, for self-consistency, the entropy of 
the spins slower than level i is zero (they are effectively fixed on the time-scale r^). 

IV NUMERICAL EVIDENCE 

In numerical simulations of the SK-model we have measured the distribution of 
the number of flips / at time t per spin: psim(/, ^)- Assuming a characteristic time- 
scale Tj for each spin aj and a distribution W{t) of these time-scales, we obtain a 
theoretical prediction of the distribution of the number of flips per spin at time t: 

Pt^iW, f, t) ^ f dr W{r) ( ) ) (^) ^1 -^y-^ ■ (13) 

Minimization of X]/=o [Psim(/) t) — Pth{W{T), /, t)]^ with respect to W{r) then yields 
the most probable distribution of time-scales W*{t), see flg. 1. 



0.0005 
0.0004 

W*{t) 

0.0003 
0.0002 
0.0001 




2000 4000 6000 8000 10000 
T 



FIGURE 1. The most probable distribution of timc-scalcs for a simulation of the SK-model 
with N = 6000, after t = 5.10^ Monte-Carlo updates per spin, for T = 0.25. 

We have found that both the number of peaks (in agreement with full RSB), and 
the separation between peaks (in agreement with inflnitely disparate time-scales) 
seem to grow with increasing system size and/or time. The total fraction of the slow 
spins, however, seems to remain flnite, which implies that a more precise analytical 
treatment for the choice of clusters or simulations with larger system sizes and/or 
times are needed. 



V DISCUSSION 



We have shown that the Parisi solution can be derived from simple physical prin- 
ciples, and can be interpreted as describing a system with an infinite hierarchy of 
time-scales where a vanishingly small fraction of slow spins act as eff'ective disorder 
for the faster ones. The block-sizes me at level i of the Parisi matrix are found to be 
the ratio of the effective temperature of that level and the ambient temperature 
T. Extremization with respect to expresses the fact that for self-consistency the 
entropy of the spins slower than level i is zero (they are frozen on the time-scale r^). 
It follows from physical considerations (i.e. the absence of heat flow in equilibrium) 
that me < 1 , V^. The fact that the fraction of slow spins vanishes, indicates that 
the cumulative entropy of the slow spins is less than extensive, and hence that the 
so-called complexity is zero (at least in this fuU-RSB model). 




FIGURE 2. Left: the ultra-metric tree, which here is a direct consequence of the hierarchy 
of time-scales. Right: qualitative picture of the distribution W{T) of (effective) temperatures 
(time-scales increase with T^s) at external temperature T (Ti,T2, resp.) in the spin glass phase. 

Although a more careful treatment of the selection of clusters is obviously re- 
quired, the main consequences of our interpretation do not crucially depend on it. 
Firstly, ultra-metricity (see fig. 2a) is a direct consequence of the existence of a hi- 
erachy of time-scales. At each level i, the different descendants of a node represent 
different configurations of the which, however, all share the same realisation 

of disorder and slower spins. Furthermore, a large fraction of the spins (see fig. 
2b) evolves at the fastest (microscopic) time-scale at the ambient temperature T, 
while a small fraction of the spins evolves at (infinitely) slower time-scales at higher 
effective temperatures. Therefore, cooling to a temperature Ti < T and heating 
back to T will leave the spins with Tcs > T unchanged, explaining memory effects. 
On the other hand, after heating to T2 > T and cooling back to T, the original 
configuration of the spins with T < T^g < T2 will be erased, which may explain 
thermo-cycling experiments [8]. Note that since the spins are discrete variables, 
finding a small number of fiips for a given spin implies long periods of stationarity 
(persistency) with only short periods of activity (avalanches). 



We expect the qualitative features of our picture to survive in short range sys- 
tems, where the time-scales need not be infinitely disparate due to activated pro- 
cesses. It is as yet unclear whether each level would represent a single cluster or a 
family of clusters. The origin of the slow time-scales of these clusters can only be 
understood if they are coupled much stronger internally, than (effectively) to the 
rest of the system (i.e. a softened version of the completely disconnected clusters 
which give rise to so-called Griffiths singularities in diluted systems [9]). In short 
range systems, the clusters would have to be spatially localised, which is in line 
with the droplet picture for short range spin glasses as proposed by Fisher and Huse 
[10]. The fact that the time-scale of a clusters increases with T^s — T, explains why 
the effective age of a system at a certain T is found to be either older or younger 
when it spends some time at a Ti(< T), T2(> T) respectively. 

A more careful treatment of the selection of clusters is clearly needed (and cur- 
rently been carried out), both for full- and 1-RSB models. This may allow us to 
calculate the complexity in such systems. Furthermore, it needs to be investigated 
whether slow clusters survive above the thermodynamical (spin) glass temperature 
Tgg. Our results suggest further numerical experiments for mean field and short 
range models, concentrating on quantities such as spin flip frequencies, avalanches, 
spatial correlations, and cluster persistency. 

To conclude, we have shown how a scheme based on an autonomous selection of 
infinitely disparate time-scales can be used succesfully to describe the statics of dis- 
ordered systems with quenched disorder and discrete and/or continuous stochastic 
variables. It allows us to derive the Parisi scheme from simple physical principles, 
and interpret its ingredients in such a way that it becomes compatible with the 
droplet picture for short range models. 

It is our pleasure to thank F. Ritort and D. Sherrington for critical comments 
and stimulating discussions. 
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